B.M. Towle homestead, later Colby home